Generalized thermodynamics of an autonomous micro-engine 
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We analyze an autonomous micro-engine as a closed quantum mechanical system, including the 
work it performs and the fuel it consumes. Our model system shows by example that it is possible 
to transfer energy steadily and spontaneously between fast and slow degrees of freedom, in analogy 
to the way combustion engines convert chemical energy into work. Having shown this possibility, 
we observe close analogies between the closed-system quantum dynamics of our micro-engine and 
the First and Second Law of Thermodynamics. From these analogies we deduce a generalized 
formulation of thermodynamics that remains valid on the micro-scale. 



Recent technological advances have spurred a renais- 
sance in basic research on the microscopic foundations of 
thermodynamics^"^, which was originally developed as 
a pragmatic description of engines^. We return to that 
starting point from a modern perspective but depart from 
previous concepts of quantum engines^MS by remaining 
strictly within closed- system quantum mechanics. Since 
it is always in principle possible to incorporate all rele- 
vant degrees of freedom within the system being stud- 
ied, rather than taking an open- system picture, it must 
in principle be possible to describe any combustion en- 
gine with a Hamiltonian. What is the simplest Hamilto- 
nian that can describe an engine? The question is funda- 
mental as well as pragmatic, since the unitary evolution 
that this Hamiltonian generates must represent a micro- 
scopic limit of thermodynamics. In this paper we iden- 
tify a Hamiltonian that describes a minimal autonomous 
micro- engine, and from its behaviour propose a general- 
ized thermodynamics that should apply to any dynamical 
system, regardless of size. 

By an "autonomous micro-engine" we mean one that 
retains two important features of larger engines. As an 
engine, it converts densely stored energy ('fuel') into 
work. Being autonomous, it is fully self-contained, re- 
quiring no power or control from outside. By incorpo- 
rating these two features, we depart fundamentally from 
previous discussions of quantum engines, which have pro- 
vided important insights but have always included either 
non-Hamiltonian heat reservoirs or parameters with im- 
posed time dependence, and hence modeled key aspects 
of engine operation phenomenologically, rather than ex- 
plaining them from first principles. We consider instead 
a particular closed system with a time- independent, Her- 
mitian Hamiltonian of the form 



H = Hw + Hp + i^ME • 



(i) 



Here the first term Hw refers to the work that the engine 
performs, Hp describes the fuel it consumes, and Hme 
defines the engine's actual mechanism itself. A schematic 
view of our particular system is shown in Figure 1. Any 
engine can in principle be described in this way, if all 
relevant degrees of freedom are properly incorporated in 
the system, but it has been assumed that this approach 



must be prohibitively complex. We will show that it need 
not be so, though our #me will be highly nonlinear. 

As Carnot pointed out, an engine can be considered 
a device for lifting a weight, because all other forms of 
work are equivalent to this^. We therefore take 
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referring to a quantum particle with mass M, height z 
and upward velocity v, subject to a constant gravita- 
tional field with acceleration g. (We refer to velocity 
rather than momentum in order to reserve the letter 'p' 
for probabilities, but we maintain the canonical relation 
[z, Mv] = ih.) Our micro-engine will lift this weight. 

To do so the engine must extract energy from some 
fuel source, represented by Hp in (|lj). Since energy is 
proportional to frequency in quantum mechanics, engines 
delivering high power for their size must harness high fre- 
quency degrees of freedom. A conventional combustion 
engine, for example, may lift a weight by turning a crank 
at a few thousand revolutions per minute, but to do so it 
extracts chemical energy from quantum transitions with 
frequencies on the order of 10 14 Hz. It is ultimately due 
to the enormity of this frequency ratio that engines de- 
liver practical power from portable fuel: the invention of 
combustion engines, therefore was a discovery of how to 
transfer energy across large frequency ratios, from fast 
to slow degrees of freedom. For the fuel of our mini- 
mal model, then, we consider a system of bosons that 
may each occupy either a ground or an excited state |=p), 
with a high transition frequency ft: 



tip = — ia+a+ — a_a- 1 . 



(3) 



At 



Here the canonical second-quantized operators a± (a±) 
create (destroy) bosons in either state. 

The role of the remaining term Hme is now simple 
but difficult: to transfer energy steadily from Hp to Hw- 
This is difficult because the large frequency gap Q, which 
makes the system an engine, is a dynamical challenge. 
For the natural forms of interaction that are normally 
considered in physics, direct energy exchange between 
fast and slow degrees of freedom is never steady, but 




FIG. 1. Schematic design of the micro-engine (fTl). Conserved 
particles populate a two-mode system with a large frequency 
gap, and transitions depend on the height of a weight. 



only a rapid, low- amplitude oscillation, whose neglect is 
the basis of workhorse approximations in most physical 
disciplines (adiabatic elimination in atomic physics and 
quantum opticiP^Il, the Born-Oppenheimer approxima- 
tion in molecular physics and chemistry 2 ^, and effective 
Lagrangians for low-frequency modes in high energy 26 
and condensed matter physicP^^U) . The principal ex- 
ception to the rule that fast and slow modes decouple is 
precisely thermodynamics. In systems with very many 
degrees of freedom, energy can pass from fast to slow 
modes by cascading through a long sequence of modes 
with intermediate frequencies, never crossing any large 
frequency gaps. The collisions of hot gas particles with 
a piston, for example, are nearly elastic, and so their 
high quantum frequencies change only slightly in each 
interaction. The rapid evolution of such high-frequency 
degrees of freedom constitutes 'the kind of motion we call 
heat ^2, which can be converted into low- frequency work 
over many small steps. The option of cascading across 
many small frequency steps is not available, however, in 
a system that has very few degrees of freedom. Is an 
autonomous micro-engine then possible? 

It is, if certain highly nonlinear interactions can be 
engineered artificially. A sufficient example is this: 
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where 7 <C ^ and k are constants with dimensions fre- 
quency and inverse length, respectively. Hme transfers 
bosons between the two states, but no term in H makes 
any net change in their total number, which we may thus 
take as a constant N. Note that Hme adds no new de- 
grees of freedom beyond the weight and fuel, and in this 
sense our micro-engine model is obviously minimal: one 
degree of freedom each for fuel and work, and none for 
the mechanism itself. 

To see that H really does perform as an engine, we 
evolve the system's quantum state \ip(t)) by numerically 



solving the Schrodinger equation with the Hamiltonian 
([l][4]), for instructive values of constant parameters. We 
express the solution in Figure [2] by plotting the proba- 
bility distribution of the weight's height z summed over 
boson states m 



N 



p(z,t)=J2\W + (N-m\-(zm))f 



(5) 



ra=0 



as a function of time. Some of the engine's features 
become more apparent in the weight's velocity distribu- 
tion p(v, i), obtained by the usual Fourier transform from 
the position representation and shown in Figure [3] We 
start from an initial state 1^(0)) in which all N bosons 
occupy the -f-mode, and the weight's state is a Gaus- 
sian wave packet, narrow in v around the mean veloc- 
ity ft/k + hk/M. Initially launched upwards, the rising 
weight decelerates under gravity until it has slowed to 
the critical velocity v c = Q/k — Tik/(2M). At this veloc- 
ity, the energy hQ of the bosonic transition matches the 
kinetic energy change if the weight velocity should in- 
crease by hk/M. Since such a velocity jump is precisely 
the operation of e %kz , Hme becomes a resonant coupling, 
and the result is that the probability distribution forks. 
With some probability, the weight simply continues to 
decelerate under gravity, following the familiar parabolic 
trajectory. With greater probability (for these param- 
eters), however, the weight makes a quantum jump of 
hk/M in upward velocity, visible as a kink in the spatial 
probability distribution of Figure [2J 

After each jump, gravitational deceleration continues, 
and when the weight slows again to v ci the forking re- 
peats. The probability of the velocity jumping up from 
v c is even higher for subsequent forkings, and so there 
is a substantial probability that the weight will continue 
to rise against gravity, at the average velocity fi/fc, un- 
til at most N forkings have occurred. After this point, 
with whatever probability remains, the weight acceler- 
ates downwards under gravity. Since N may be arbitrar- 
ily large, however, the weight can in principle be lifted 
to arbitrary height. Examining the full quantum state 
\i/j(t)), we can confirm that the work done on the weight 
is exactly matched by the energy lost from the boson 
system, and that each quantum jump in the weight's ve- 
locity occurs with a transition of one boson from the 
+-state to the — state. The micro-engine consumes its 
fuel quantum by quantum. 

From p(v, t) in Figure [3] we can see that the micro- 
engine induces true quantum jumps in the weight veloc- 
ity, and not just short bursts of high acceleration: the 
instant at which the velocity jump occurs is probabilisti- 
cally spread over a short interval, but there is never any 
probability, during this interval, for the weight velocity 
to take any intermediate values. It is expected that a 
quantum system that is slowly driven, as our boson sys- 
tem is by our weight, will exhibit such energy jumps; see, 
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FIG. 2. Probability density in 
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of the weight's height 



as a function of time, with nonlinear color scaling to enhance 
detail. N = 10 bosons initially occupy the +- mode and the 
weight's initial state is a Gaussian wavepacket, with mean 
velocity Q/k + Kk/M and velocity width (Kk/M)/ 128. Pa- 



rameters are Q = hk /M, 
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FIG. 3. The probability distribution p(v,t) of the weight's 
velocity in [l/ff 1 , incoherently summed over boson distribu- 
tions, for the same evolution as shown in Figure [2] 



for example, Figure 8 of RefM Because our entire sys- 
tem is closed, we see here the corresponding back-action 
jumps of the slow weight. 

The evolution represented in Figure [2] is a quantum 
analog to the familiar situation of driving a car uphill 
at a nearly steady speed. The steadiness of this speed is 
what is meant by the weight being 'slow'. Demonstrating 
that this behavior occurs is the non-trivial crux of our pa- 
per: autonomous micro-engines are possible. Since con- 
servation of total energy is already guaranteed in closed- 
system mechanics, our single example proves the general 
statement: While total energy is conserved, it is possible 
to transfer energy between fast and slow degrees of free- 
dom. This statement is an obvious analog of the First 
Law of Thermodynamics. But is it only an analog? An 
established perspective on thermodynamics, dating back 
to Clausius 21 , makes time scales the essential difference 
between heat and work in any case. We therefore pro- 
pose the italicized statement above as the generalized 



formulation of the First Law. It reduces via Clausius to 
the standard formulation in macroscopic systems, but it 
applies to microscopic systems as well. 

Along with the possibility of raising the weight, the 
multiple probability branches of Figure [3] show that each 
velocity jump may also fail to occur, leading to an av- 
erage engine efficiency lower than one. This observation 
will lead to our proposed generalization of the Second 
Law of Thermodynamics. As the detailed analysis in 
the supplementary material shows, we can understand 
the micro-engine's inefficiency analytically in the sim- 
plest limit, where A/7 <C hk 2 jM as in Figured by apply- 
ing Landau-Zener post-adiabatic theory^EQJ This yields 
the approximate probability of the lower branch in the 
n-th bifurcation 



V n = exp 
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n(N + 1 - n) 



(6) 



In practical terms this is the probability that the micro- 
engine, having successfully 'burned' (n — 1) quanta of 
fuel, spontaneously stalls, as a quantum fluctuation, and 
fails to do any further work. 

We speak of probabilities because these describe the 
results of measurements on the weight alone, but the full 
evolution is quantum mechanically unitary, and the fi- 
nal state of the entire system is a coherent 'Schrodinger's 
Cat' superposition of all different population distribu- 
tions of the bosons, with correspondingly different wave 
packets for the weight (all at different heights). This is 
a pure quantum state, but it is one in which the fast 
and slow degrees of freedom are highly entangled. The 
only observables that could be sensitive to the quan- 
tum coherence between the branches in this superposition 
would be those that directly couple states with different 
n. The Heisenberg time evolution of such operators, un- 
der H, involves rapid phase factors e ±int . Observing 
quantum interference between the superposed branches 
of the highly entangled state \ip) thus requires measure- 
ments that can resolve the short time scale 1/Q. In- 
spired by the micro-engine Hme itself, one might perhaps 
evade this requirement by including a factor e ±%kz in ob- 
servables; but this would require spatial resolution on 
the short scale 1/fc. Observing quantum interference be- 
tween the Schrodinger's Cat branches therefore requires 
high resolution in either space or time. As far as coarse- 
grained measurements that lack such resolution are con- 
cerned, the actual unitary evolution of the system is in- 
distinguishable from the probabilistic evolution in which 
the micro-engine has a random chance, given in the limit 
A^7 <C hk 2 /M by (|6J) , of spontaneously stalling instead 
of performing its nth quantum of work. 

The efficiency of the micro-engine can be high, because 
V n can be low; but V n cannot be zero, so efficiency can- 
not be perfect. If the system begins in an eigenstate 
of high-frequency energy, there is always a chance that 
some of this energy fails to transfer to the low-frequency 



sector. This limitation must apply to any autonomous 
micro-engine that is at all like our model, because quan- 
tum adiabatic approximations are not exact except in 
trivial cases. This suggests the general conjecture: It is 
impossible for an autonomous system to convert any def- 
inite amount of high-frequency energy entirely into low- 
frequency energy with unit probability. This statement 
constitutes a close analog to the Kelvin-Planck formula- 
tion of the Second Law of Thermodynamics 22 , according 
to which no process can convert heat entirely into work. 
From the identification of heat and work as high- and 
low-frequency energy, again according to Clausius^, we 
therefore propose it as a generalization of the Second 
Law, which shall apply to all dynamical systems, large 
and small. The generalized Second Law remains proba- 
bilistic even in small systems, which evade the ensemble 
arguments of conventional statistical mechanics, because 
probabilities arise from the effective low-frequency deco- 
herence of quantum superpositions. 

The inference from micro-engine inefficiency to the Sec- 
ond Law is by no means superficial. As we have noted, 
the imperfect adiabaticity of micro-engine operation di- 
rectly implies growing entanglement between fast and 
slow degrees of freedom. This means the effective loss of 
information about slow evolution, as that information is 
transferred into entanglement that is unobservable within 
the slow sector. This is the same general phenomenon 
that is thought to explain thermodynamic entropy in- 
crease in macroscopic closed systems, whose exact evolu- 
tion is after all just as unitary as that of small ones. We 
have here demonstrated this phenomenon explicitly from 
first principles. It should not be difficult to test our pro- 
posals experimentally, since the essential requirement is 
not to realize our model exactly, but only to achieve sim- 
ilarly modulated coupling between fast and slow degrees 
of freedom, and prospects for doing this with trapped 
atoms or ions, for example, are easy to envision. In the 
longer term, perhaps the heroic ingenuity of the Steam 
Age will flourish again on the nano-scale, and micro- 
engineers will craft practically useful micro-engines. Our 
demonstration that autonomous micro-engines are possi- 
ble has in any case shown that thermodynamics is not ir- 
reducibly macroscopic after all, but may be universal. In 
particular, our generalized formulation of the Second Law 
of Thermodynamics is now formulated within a Hamilto- 
nian framework, so that it can be tested with the theo- 
retical and experimental tools of closed-system quantum 
mechanics. 
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We can understand the micro-engine dynamics by ex- 
actly mapping the already simple Schrodinger equation 
generated by (fil) onto an even simpler one. Without loss 
of generality we take the total quantum state \ip) to be 
an eigenstate of TV with eigenvalue N, and represent \i/j) 
as 

N 

\^(t)) = J2 dvi/) m {v,t)\m)+\N-m)-\v-mhk/M) {1) 



where \v) are eigenstates of v with eigenvalue v. By then 
re- writing 



ip m (v,t) =:(p m (v + gt 
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we eliminate derivatives with respect to v from the 
Schrodinger equation for (p m (y,t): 
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The time dependence of h m (t) is strictly an artifact of the 
exact reduction to a single dynamical degree of freedom 
via p|. The term in h m proportional to (m — N/2) 2 is 
likewise induced by the mapping, and can be considered 
an effective interaction between the bosons mediated by 
their interaction with the weight. It is not due to any 
direct interaction between the bosons, since in H there 
is none. The full system of weight plus fuel still evolves 
under the time-independent H. Solving Eqn. (b| for (p m 
with v as a fixed parameter, and inserting the solution 
into ([2| to obtain ip m (v, £), yields the solution for the full 
system. 

Although the mapping ([2| is only exact because the 
weight's potential Mgz is linear, a similar mapping will 
be valid as a Born-Oppenheimer approximation for a 
wide range of potentials V(z). 

We can understand the dynamics described in (|3| by 
analyzing its instantaneous energy eigenspectrum, which 
in the limit where Nj <C Tik 2 jM consists of a series of 
well separated avoided crossings, as exemplified in Sup- 
plementary Figure [l] We can solve the general prob- 
lem by referring to the results obtained independently 
by Landau and Zener in 193 J 29 * 30 ^. Both considered a 
two-state Hamiltonian 
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ei ei2 

ei2 ^2 
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Supplementary Figure 1. Instantaneous energy levels. The 
main plot shows the set of instantaneous eigenvalues of the full 
effective Hamiltonian whose matrix elements are h m (t)5im — 
him from (|3| (blue), as functions of t, for N — 10 particles 
and all parameters as in Figure [2] above. The functions hm 
alone (purple, dashed) are also plotted but can only be seen 
to differ from the blue lines in the small plots above, which 
show the surroundings of the two crossings marked A and B, 
in the lowest arc of the web. For larger N the plot remains 
similar but becomes more dense. 



with time-dependent diagonal entries 



2tt 



(ei - e 2 ) = at. 



(5) 



Computing the exact time evolution, Landau and Zener 
showed that corrections to the adiabatic evolution are 
negligible, except in the brief episode of the avoided cross- 
ing of the instantaneous energy eigenstates. Although 
brief, this episode may have lasting consequences: the 
probability that during it the system will jump from one 
adiabatic state to the other is 



exp 



2^£?2 
h 2 a 



(6) 



In the limit A^7 <C hk 2 jM of our problem, the evolu- 
tion is adiabatic except very near the avoided level cross- 
ings. In particular, therefore, the numbers of bosons 
in + and — levels remain constant except near those 
crossings. In the brief intervals around the crossings, 
we may apply the non-perturbative Landau- Zener theory 
presented above to the non-adiabatic evolution within the 
two-dimensional subspace spanned by the two crossing 
eigenstates. This yields the probability that the system 
will emerge, after the crossing, in the upper of the two 
crossing energy levels if it started in the lower, or vice 
versa. 

When we start with all bosons occupying the +- level 
(as we have in Figure [2] and [3]) , the system is initially 
in the ground state of the eigenspectrum of pi). In the 



limit Nj <C hk 2 /M, the only substantial opportunities 
for any bifurcation of the occupation amplitude distri- 
bution will actually be the N crossings that lie along 
the lowest arc in the 'web' shown in Supplementary Fig- 
ure [l| This is because in this limit we may treat hi m 
as a perturbation, and in first order perturbation theory, 
him only couples h m eigenstates with m differing by one. 
The crossings between these neighboring levels are pre- 
cisely those along the lowest arc of the web; these are 
the points at which the two options are for one boson to 
descend from the + to the — mode (this is taking the 
lower branch of the crossing, and so continuing around 
the lowest arc of the web), or else for the boson distri- 
bution to remain unchanged (this is proceeding straight 
through the crossing, and so leaving the lowest arc). Ac- 
cording to Landau-Zener theory as applied within the 
crossing subspace, the probability with which the system 
takes the upper branch of the n th crossing, so that the 
transition from n — 1 to n bosons in the lower state does 
not occur, is that stated in (|6|), namely 



V n = exp 
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(7) 



All crossings above the lowest arc in the Supplementary 
Figure [l] web are avoided only at higher order in pertur- 
bation theory, and hence in the limit A/7 <C hk 2 jM are 
passed through in straight lines (i.e. diabatically, with 
no change in boson distribution and hence no transfer of 
energy to the weight) with probability extremely close to 
one. In this limit, therefore, the chance that the engine 
will stall at any crossing may still be large or small, de- 
pending on the independent ratio kg/j 2 , but the chance 
that the engine will resume operation after once stalling 
is negligible. 

When we transform the results of the reduced descrip- 
tion ([3]) back to the full system, each crossing within 
the web of Supplementary Figure [T] corresponds to the 
weight hitting the critical velocity v c and undergoing a 
wave packet bifurcation, either jumping in velocity or 
not. Therefore, the probabilities (|7|) correspond directly 
to those of the probability distribution branches in Fig- 
ure [2] and 03 

It is worth noting that although the lasting conse- 
quence of the crossing episode are simply the probabilities 
P and 1 — P of the two crossing levels, the brief non- 



adiabatic evolution that produces them is non-trivial, 
with probability generally oscillating back and forth be- 
tween the two levels many times before settling down to 
the asymptotic results. This oscillating evolution shows 
up if one looks closely at Figure [2j as in Supplementary 
Figure [2] 

Generalizing these results beyond the simple regime of 
Nj <C hk 2 /M becomes complicated quickly, because the 
intervals of non-adiabatic evolution around the crossings 
can extend to encompass multiple crossings, and because 
the higher-order crossings also become important, lead- 
ing to a complex flow of interfering quantum amplitudes 
through the entire web of h n levels. With numerical anal- 
ysis in a wide range of regimes, however, even extending 
to the fully classical limit, we have confirmed that the 
micro-engine operates quite generally and robustly - but 
always with some degree of inefficiency and uncertainty. 
We have also confirmed in the classical limit that the en- 
gine operates for a range of different nonlinear potentials. 
Our results therefore remain qualitatively valid within a 
much broader regime than explicitly discussed here. 




Supplementary Figure 2. Magnified view of the first probabil- 
ity bifurcation in Figure [2] showing the probability distribu- 
tion p(z, t) of the weight's height in the immediate vicinity of 
the first avoided crossing ('A') in the time-dependent reduced 
problem. The ripples visible on this scale show oscillation 
of probability between the two possibilities of stalling and 
working. For higher values of hk 2 /(M7), the non-adiabatic 
interval is so brief that the branches do not have time to sepa- 
rate appreciably within it, and these ripples become invisible. 
The color scaling is as in Figure [2] 



